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(57) ABSTRACT 

The preferred embodiment of the invention includes hard- 
ware and software for scanning objects and extracting their 
geometry and color information so as to generate their 3D 
(three dimensional) representations in a computer. The pre- 
ferred embodiment uses a computer, a video camera, a light 
source, and an indicator located within the field of view of 
the camera in a fixed position. Preferably, the light source 
projects a crisp line of light on the scanned object. The 
software of the preferred embodiment processes the frames 
produced by the camera. It preferably locates the illuminated 
line and the indicator, and uses this information to determine 
3D coordinates of the illuminated points. The 3D coordi- 
nates of the points are used to construct 3D representations 
of objects. The preferred embodiment also obtains color 
information of the scanned object and maps it to the 3D 
representation. 
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METHOD AND APPARATUS FOR value of the angle can be used as discussed in more detail 

GENERATING THREE-DIMENSIONAL below. The preferred system also employs an indicator (e.g., 

REPRESENTATIONS OF OBJECTS a bright light source) located within the field of view of the 

camera in a fixed position, preferably, in the background of 
5 the object. Note that the only hardware component 

FIELD OF THE INVENTION employed by the preferred embodiment which is perhaps not 

an off-the-shelf component is the light source for projecting 

This invention relates to a method and apparatus for a crisp line of light, 

scanning objects and generating three dimensional repre- The software of the preferred embodiment includes an 

sentations of them, preferably using a computer. 1Q application running on the computer, which presents a user 

interface for a user to interact with the software, interprets 

BACKGROUND OF THE INVENTION video frames produced by the camera and creates 3D geom- 

,. . ^,u^,>\ ■ • . t 4 etry and color information for the scanned object. The 

Tlu-ee-dimensional ("3D ) graphics is an important appli- SQ ^ m ferabl stores the resultant 3D re p rese ntation of 

cation of computer technology, but the creation of 3D the scanned object using a commtzciilly standard format, 

computer representations of objects is a complicated and 15 such as yRMLl, VRML2, DXF, 3DMF and depth-map. 

time consuming process. Sometimes the best way to create Such formats for storing 3D graphics are known to people 

a 3D representation of an object on a computer is to scan in skilled in the art. The computational requirements of the 

the object using a 3D scanner. This is typically the case when software are such that it can be hosted on a standard personal 

attempting to image people's faces in 3D. computer such as a PC or Macintosh. For example, in one 

3D scanners exist, but they are typically expensive and 20 preferred embodiment the computer is Macintosh with a 

complex machines using lasers, optics, motors and sensors, Power PC 8600, 200 MHZ CPU, internal AV (Audio Video) 

usually employed in commercial environments. Such com- capability, 64 Meg. of RAM and 4 GB of hard drive. In 

mercially available 3D scanners are generally outside of the S cn f «1, even a computer with lower capabilities may be 

price range of a typical consumer. Yet, given the current used for L lhls purpose. A person skilled in the art will be able 

proliferation of computer technology, it is desirable to * to match proper hardware to the desired processing require- 

develop a scanner that could enable a wide variety of users, " . 

including consumers, to scan objects (including people and ™ e Preferred system captures color information as well 

other life forms) and generate their 3D computer represen- " ^geometry of the object by swiping the scanner over an 

™_ A . . f f u • * object. The scanner can scan objects of varying size. As 

tations. Thus, there is a need for a scanner which is not , c c J , , / * 

, A A . A . „ - ™ noted, the scanner of the preferred embodiment uses a 
prohibitwelrexpensive and at the same^tune allows for-3° standard ^ camefa ^ can be ^ Ued b the user The 

generating 3D computer representations of objects of suffi- [cTI cd scanner is hand operated (not motorized) which 

ciently acceptable quality. In this regard, it is also desirable can reduce ^ ^ ^ ^ ^ to ^ bABtct& areas 

that such a scanner be constructed priman y with off-the- m a mor6 dctailcd manner b moyin ^ cam6ra mor6 

shelf components, which are readily available to consumers sJowl ^ scannm ^ ^ mteresti arts in ]ess detai , 

and which can also be used for other applications. by moving m6 cam6ra fas(6r> ^ ^ to create a 3D represen . 

A typical 3D scan is a time consuming process. Yet, in tation of the object with varying resolution, 

practical applications, certain objects do not require high Advantageously, the preferred scanner uses the video 

quality 3D representations (and, thus a time consuming capture capabilitics of a conventional personal computer. It 

process), while other objects should be represented with ^ ^ preferably uses plain U ^ t ( not laser)> which ^ ^ 

high quality. Further, it may be desirable to represent certain c h 6apc r and more readily available, 

scanned features of an object with higher resolution than the The ferred Mflwm ^ videQ daU duced b the 

other features. Thus it is desirable to develop a 3D computer camera durin ^ eva , ua , e me orientalion of the 

scanner that * capable of generating 3D representations of camera B idcntifyin the location of the indicalor which 

varying quality. And, it is also desirable that such a scanner has a iflc ^ brightness or paUerD( the software can 

would permit a user to scan different portions of an object evahla , e tfae orientatioD of mc cam6ra in re]ation t0 the 

with different resolutions, so that the portions of greater objec , ^ elimina , es ^ need for MM0I8 which mdicate 

interest to tbe user are scanned with higher resolution. , hc ori6ntation of the camera during and( therefore> 

Auser may need to scan objects at locations that are away further lowers the complexity and cost of the system. The 

from home or office. In this regard, it is further desirable that J0 scanner can be used "off line" without being connected to 

such a scanner would be capable of first recording scanned the computer, and then the resultant video can be transmitted 

images on a video medium (e.g., on a tape, video disc, or ( 0 the computer and processed later, 

digital media) and then at a later time processing the stored the preferred embodiment provides a 3D scanning 

images to obtain a 3D computer representation of the object system that is affordable by many consumers and sufficiently 

depicted on the stored images. 5J simple t0 set up and use by such consumers . Y et, it is 

SUMMARY OF THE INVENTION sufficiently versatile to be employed for commercial appli- 

cations as well. 

The system of the preferred embodiment includes hard- BRIEF DESCRIPTION OF THE DRAWINGS 
ware and software for scanning objects and extracting their 

geometry and color information so as to generate 3D rep- 60 ^ invention will be better understood when taken in 

resentations in a computer. In the preferred embodiment the conjunction with the following detailed description and 

system uses an off-the-shelf video camera and an ordinary accompanying drawings, in which: 

personal computer. Preferably, the camera is mounted on a FIG - 1 schematically illustrates the hardware of the pre- 

standard tripod and connected to a light source that projects ferred embodiment. 

a crisp line of light on the object from a slight angle with 65 FIGS. 2 and 3 schematically illustrate the computer 

respect to the direction of the camera. In one preferred software of the preferred embodiment. 

embodiment, this angle is about 10°, although a different FIG. 4 illustrates a frame of the scanned output. 
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DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

The hardware of the preferred embodiment is illustrated 
in FIG. 1. The hardware includes a scanner device and a 
computer system. The computer is symbolically shown as 
150. It is connected to the camera via interface 160. The rest 
of the equipment in FIG. 1 belongs to the scanner device 
(except for the scanned object illustrated at 140). 

In general, the scanner device obtains video data repre- 
senting a scanned object and provides this video data to the 
computer or stores it on a medium for subsequent transmis- 
sion to the computer. The video data comprises a set of 
frames produced by the camera during the process of 
scanning. The computer uses software to receive and process 
the video data obtained by the scanner device so as to 
.construct the 3D geometry of-the scanned object and assign 
color information to the object. 

The scanner device, illustrated in FIG. 1, includes the 
following hardware components: camera 100, light source 
110, support 120, and indicator 130. In the preferred 
embodiment, the camera 100, support 120 and indicator 130 
are conventional off-the-shelf components that are readily 
available for purchase by consumers. Preferably, only the 
light source 110 is specifically made for the scanner. Thus, 
preferably, the more expensive and complicated parts of the 
scanner are conventional off-the-shelf parts which can be 
supplied by the end user and also can be used for other 
purposes when the scanner is not in use. Of course, in other 
embodiments, these components can be custom-made for 
the scanner and, conversely, in some embodiments the light 
source 100 can be an off-the-shelf component. 

The light source 110 preferably produces a crisp line of 
light. There are various ways to construct such a light source 
as known in the art. Four preferred ways for constructing 
such a light source for producing a crisp line of light are 
based on (1) the light bulb shape, (2) the use of a reflector, 
(3) the use of a lens, and (4) the use of shutters. 

More specifically, the first preferred approach is to use an 
elongated light bulb, preferably a halogen light, which is 
sufficiently powerful to produce a line of light. Halogen is a 
good source for white light rich with IR (infra-red) which 
makes it well suited for video cameras, which are usually 
sensitive to IR. In one preferred embodiment, a 150- watt 
halogen light is used. To produce a horizontal line, this light 
bulb is mounted horizontally and for a vertical line it is 
mounted vertically. 

The second preferred approach is to use a reflector 
mounted behind the bulb to condense the light into a narrow 
strip. The reflector can be constructed from a reflective 
surface such as polished metal and shaped in a curved 
mariner. 

The third preferred technique is to use a lens that can be 
fitted in front of the light bulb to condense the light into a 
narrow line. Such a lens should be similar to a projection 
lens and shaped as a prism. FIG. 1 symbolically illustrates 
the lens as 105. 

In addition, shutters can be used in front of the light bulb 
and either in front or after the lens to obstruct any light other 
than a narrow line from reaching the object. Shutters may 
also be used even if the lens is not employed in constructing 
the light source. 

Any of these techniques or combinations thereof that 
result in a crisp line of light hitting the object 140 will be 
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sufficient for a scan in accordance with the preferred 
embodiment. As noted, other techniques may also be used 
for constructing the light source as known in the art. For 
example, a laser can be used as a light source. 

5 As noted, the scanner employs the video camera illus- 
trated as 100. Conventional video cameras capable of cap- 
turing a sequence of frames can be used as camera 100. For 
example, well known cameras such as camcorders, Hi 8 
cameras, surveillance cameras, digital video cameras, digital 

10 computer cameras (Connectix QuickCam) can be used as 
camera 100. For example, in one preferred embodiment the 
system uses the Hi 8 Nikon VN/750 camera. Although, 
preferably, the camera 100 is capable of storing the images 
on a storage device such as a cassette, tape, disk or diskette, 

15 this capability is not required and, in other embodiments, the 
camera 100 may not have storage capability. If the camera 
100 is capable of storing the captured video, the scanner 
device 100 can first be used autonomously without being 
connected to a computer. In this case, the computer would 

2 0 process the frames produced during scanning at a later time. 
If the camera 100 has no video storage capabilities, the 
frames captured by the camera during scanning must be 
transmitted to the computer and either stored. on the com- 
puter or .processed in real time. > 

25 In order to enable the computer to interpret the video 
images (also referred to as video data) obtained by the 
camera 100 as 3D geometry, the scanned object is illumi- 
nated by the light source 110 with a narrow crisp line of light 
which hits the object from a slight angle (illustrated as angle 

30 _ 112)_ with respect to_ the direction of the camera. The 
scanning is preferably done in substantial darkness (but 
complete darkness is not required). The light source 110 can 
be incandescent, fluorescent, halogen, laser, infrared or any 
. light source that is visible to the camera in use. The light 

35 source 110 may be polarized, but the scanner does not 
require the use of polarized light. Halogen light is generally 
preferred. For example, one such preferred embodiment uses 
a 150 watt halogen incandescent light bulb. As discussed 
above, to form a crisp line of light, reflectors, lenses and 

40 shutters may be used to concentrate the light and block out 
the unwanted areas. 

The line produced by the source 110 may be a vertical or 
a horizontal line. The direction of the scan is perpendicular 
to the direction of the line produced by the light source, i.e., 

45 the lightsource that produces a vertical line is used for a 
horizontal scan and a horizontal line is used for a vertical 
scan. Computer software that processes scanned data can 
accommodate both directions of scanning (vertical and 
horizontal). Some objects are scanned better in a specific 

50 direction depending on the geometry of a given object. For 
example, a human face is symmetrical in the horizontal 
direction but not symmetrical in the vertical direction. 
Accordingly, a vertical scan is preferred for a face. In a 
horizontal scan of a face, the nose may obstruct certain areas 

55 of the face during scanning. 

The light source 110 is preferably connected to the camera 
in a rigid manner so as to insure that the angle 112 and 
distance 115 between the camera and the light source remain 
constant. The angle 112 between the directions of the camera 

60 100 and the light source 110 is preferably adjustable to 
assure that the area of the scanned object, illuminated by the 
light source, is within the viewing area of the camera. In one 
embodiment, when the object 140 is a human face posi- 
tioned about 4 feet away from the camera (see distance 114), 

65 the distance 115 between the light source and the camera is 
approximately 12" and the angle between the light source 
and the camera is between 10° and 12°. Depending on the 
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distance between the camera and the object, the angle 112 faces may include a modem, a network interface, or other 

may need to be adjusted to assure that the line produced by connection to external electronic devices, such as a serial or 

the light source appears on the frames captured by the parallel port. The computer 150 also supports a communi- 

camera during scanning. The value of the angle 112 is also cation interface with the camera 100. This interface should 

determined in view of the trade-off between the accuracy of 5 be compatible with the specific video device employed in a 

the scan, which is improved with an increased value of the particular system configuration. The link between the com- 

angle 112 and the possibility that some scanned features may puter 150 and the camera 100 is symbolically shown as 160. 

become obstructed on the resultant image, which possibility The computer hosts software that processes video data 

also increases as the angle 112 increases. provided by the scanner and generates 3D representations of 

The camera 100 and light source 110 are preferably 10 the scanned objects. The computer 150 has a storage 

mounted such that they move together. Both camera 100 and capacity, which is at least sufficient to store the geometry and 

light source 110 are preferably supported by the support 120 color information of scanned objects in addition to the 

in a way that allows movement in the pan/tilt directions but system's software and the application software discussed 

restricts the movement in the swivel direction. In other here. It also has a display and input devices to present the 

words, the camera 100 and light source 110 are permitted to 15 user with a means of interaction. As noted, a Macintosh 

move up and down or left and right in one plane. As personal computer with a 200 MHZ CPU, 64 Meg of RAM, 

illustrated in FIG. 1, a typical tripod 120 is preferably used 4 GB hard drive and audio video (AV) capabilities should be 

for such a support, although other known camera mounts sufficient for this purpose. 

may also be used to provide for support 120 as known in the To capture video frames provided by the camera, the 
art. In addition, in some embodiments motorized pan/tilt 20 computer 150 is equipped with a video digitizing board if an 
heads may be used to control remotely the movement of analog video camera is used, or a parallel/serial communi- 
camera 100 and light source 110. cation port if a digital camera is used, or a Firewire corn- 
It should be noted that in the preferred embodiment, there munication port if a DV video camera is used. These are 
are no sensors connected to the camera. To enable the off-the-shelf devices known in the art. Other means of 
computer to determine the orientation of the camera for a 25 receiving video frames from the camera may also be used as 
given frame, a known static indicator illustrated as 130 is known in the art. 

introduced into the field of view of the camera 100. Thus, The software for processing video data generated by the 

when the camera is moved the indicator is depicted in a scanner resides in the computer as known in the art. This 

different area of the frame produced by the camera. As a software may be used to process "live video" as it is 

result, the orientation of the camera can be determined based 30 captured in real time by the camera 100, or it may be used 

on the position of the indicator within the frame. The to process video data that has been captured by the camera 

indicator 130 is static and does not move throughout the 0 f the scanner and stored on a storage medium, e.g., 

scanning process. recorded on a tape or disc. 

The indicator 130 is preferably such that it is easily 35 The software application for generating 3D representa- 
identifiable on the frames generated by the camera to enable tions functions in accordance with the steps illustrated in 
the computer to locate the representation of the indicator FIGS. 2 and 3 and discussed below. It should be noted that 
within the frames. Preferably, the indicator 130 is a bright the process described herein assumes that the line of light 
light which is easy to detect, because the scan takes place in produced by the light source 110 is horizontal (and therefore 
substantial darkness. In addition, a distinctive color or a 4Q the scan is vertical). Based on this disclosure, a person 
pattern can be used as indicator 130 as further discussed skilled in the art will be able to modify the software 
below. It should be noted that if a bright light indicator is described herein so as to process images resulting from a 
used, its brightness should preferably be higher than the horizontal scan employing a vertical line. In this case, the 
brightness of the line of light generated by the light source processing described here is rotated by 90 degrees as under- 
110 to enable the software to distinguish the indicator pixels 45 stood by a person skilled in the art. 
from the line pixels. If a distinctive color or a pattern is used, First> thc software receives a frame of video and converts 
the scan should take place in semidarkness. If a large object j t j nto a digital structure that is convenient for processing by 
is to be scanned and not the entire object can be seen at once software. Generally, a typical video camera produces 30 
within the field of view of the camera, more than one frames per second. Usually a portion of these frames are 
indicator may be used. In this case, the indicators should be 5Q processed by the computer 150. The number of the pro- 
spaced so that at least one indicator is visible to the camera cessed frames per unit of time depends on the video pro- 
during scanning. cessing and other capabilities of a particular computer. 

The computer 150 of the preferred embodiment is an a convenient way to store a frame of scanned video data 

ordinary personal computer with conventional video capa- ^ to represent it in digital form as an image comprising a 

bilities that include the capability of receiving video data 55 pixel map where each pixel is represented by 3 numbers for 

and storing the received frames/Computer 150 is preferably its RGB values, or by one number if the scanner generates 

a personal computer, but can be a workstation, or a larger g ra y scale images. There are various conventional ways of 

system such as a minicomputer. One skilled in the art of converting video data into such a structure as known to 

computer systems will understand that the present invention persons skilled in the art. Although these techniques may 

is not limited to a particular class or model of computer or 60 vary among different computers and operating systems, 

a particular circuit configuration. generally speaking, they are the services provided by the 

Such a typical computer system includes a central pro- video digitizing hardware and the operating system. A 

cessing unit (CPU), a primary memory, one or more storage person skilled in the art will know how to integrate them in 

devices of secondary memory, e.g., hard disk drives, a particular computing environment. Depending on the 

CD-ROMS, DVDs, input and output devices, and commu- 65 storage and processing capabilities of the computer, in one 

nication interfaces. A system bus is provided for communi- embodiment the- computer digitizes and processes frames 

cation between these elements. The communication inter- one at a time as they arrive from the video camera. In 
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another embodiment all the frames are first digitized and convolution etc. As noted, a highly illuminated area repre- 

stored. Thereafter, they are processed by the computer as senting the bright light indicator may also appear on the 

discussed below. Regardless of the specific embodiment, screen. The relative brightness of the indicator and the 

each frame is processed in accordance with the principles brightness of the illuminating line should be adjusted such 

discussed below. s that it is easy to differentiate them. One approach is to make 

Initially, a user enters certain parameters specific to a sure that the indicator is significantly brighter than the 

given scan, as indicated in block 200 of FIG. 2 and discussed illumination light. In this case, as noted, pixels brighter than 

in further detail below in connection with FIG. 3. Next, the a given threshold are not considered in determining the 

software begins processing the frames one by one (see block pixels of the line. 

205, FIG, 2). io Next, the software determines the location of the orien- 

After a frame of video has been received as shown in 205, tation indicator within the image of the currently-processed 

software executing on the computer 150 identifies the points frame. See block 215, FIG, 2. The method used for this 

on the frame where the line of light illuminated the object. purpose depends on the type of the indicator. The following 

See block 210, FIG. 2. Since a visible non-polarized source processes determine the coordinates of one pixel that rep- 

of light may be used as light source 110, the line of light on 15 resents the location of the indicator, 

a given frame may have some thickness, Hiis line is usually If a bright light indicator is used, the software goes 

wider if the object is further away from the camera and the through the image pixel by pixel, identifies the brightest 

light source. TTie goal of this process (in block 210) is to pixel and store its coordinates. In order to achieve a more 

identify a line of 1 -pixel thick. For this reason, in some stable point, the locations of several brightest pixels are 

embodiments the software identifies the edge of the line of 20 identified and then their locations are averaged and stored as 

light. Preferably, one of the following three methods are the indicator point. The number of such several points can be 

used for identifying the line, although other edge detection a user-defined parameter or it can be provided by the system, 

methods can be employed as understood by a person skilled For example, a user may select a threshold of brightness of 

in the art. Generally, the methods discussed below are based the pixels that can be considered for this purpose (or the 

on going through the pixels vertically from top to bottom, 25 threshold can be preset in the software). As noted, when the 

column by column and finding the pixel that is most likely bright light indicator is used, it should be significantly 

the best representation of the line. brighter than the brightness of the illuminating line so as not 

It should be noted that typically, the line is not a straight to confuse the pixels belonging to the indicator and those 

line but curved due to the 3D nature of the object. Such a line belonging to the line. 

is illustrated as~410 and 420 on FIG. 4: if the indicator uses a ~disUncrct)to> 7 me so'ftware^xam- ' 

One method of identifying a pixel on the line involves ines each pixel of the image and identifies the pixel that has 

identifying the brightest point. This method identifies the the color which is the closest to the defined color of the 

brightest point in each column and defines it as the point on indicator. This can be done by applying the following 

the line. A user-defined threshold value is used to screen out 35 formula to each pixel: 

the points that are most likely not part of the line. 

The software goes through the columns pixel by pixel and I^ltaCtolor^quare root of ((DefinedColoi .Red-PkelColor.Red) 2 + 

_ . , . . . . . . /\ , /, . . (DefLnedColor.CTreen-PLxelCo]or.Green) 2 +(DefinedCoIor.Blue- 

ldentifies a pixel in each column with the highest brightness PixelColor.Blue) 2 ) 

and if the brightness is greater than the predetermined 

user-defined threshold, the pixels are stored as points of the 40 In this expression the DefinedColor is the color of the 

line. It should also be noted that if a bright light indicator is indicator and the PixelColor is the color of an examined 

used, its brightness is typically higher than that of the line of pixel. After all the pixels have been processed, the pixel with 

light. In this case, an upper threshold is used so that the the smallest Delta_Color is selected as the indicator point, 

"brightest pixel" refers to a pixel brighter than the other To achieve a more stable point, the location of several pixels 

pixels in a column, but not as bright as the expected values 45 with the closest DeltaColor values can be identified and then 

of the indicator pixels. That is, the pixels with brightness their location can be averaged and stored as the indicator 

above a certain threshold are simply not considered. point. The number of such pixels is defined by the user or it 

An alternative method identifies the first bright point in can be a default stored in software. For example, the user can 

each column. Again, a lower and possibly upper (for a bright indicate the lower threshold value of the DeltaColor. The 

light indicator) thresholds may be supplied by the user or 50 pixels with the DeltaColor lower than the threshold are then 

defined in the system and the software scans the columns selected. 

pixel by pixel. In each column the first pixel which bright- If a pattern is used to define the indicator point, a 

ness is higher than the lower threshold (and below the upper representation of the pattern should be pre-stored in the 

threshold) is defined as a point on the line. computer. A single consistent point within the pattern is 

A third preferred alternative is based on the greatest 55 defined as the indicator point. To identify the pattern, the 

difference in brightness. This method finds the brightest software overlays the pre-stored pattern on all possible 

pixel in accordance with the first method described above locations on the image (heightxwidth of the dimension of 

and then it goes back a given number of pixels (this number the pattern) and determines the location where all the pixels 

can be defined by the user). In this process, the software of the image are the most similar to the pattern. The 

compares each pixel to the one before it. The pixel that has 60 following formula is used for this purpose: 
the greatest difference in brightness from the one before it is 

defined and stored as a point on the line. In other words, the r^itoColor^quare root of ((Defined^lor.^ 

t f • (DeftnedColor.Grcen-PixelCo1or.Orecn) 2 +CDefinedColor.Blue- 

resultant 1 -pixel line represents the edge of the upper PixelColor Blue) 2 ) 

boundary. 

A person skilled in the art may use other methods for 65 The sum of all values of DeltaColor of the pattern pixels 

extracting a line from an area, as known in the art. Such is used as a measure of the total similarity of the current 

other techniques include edge detection, erosion, Sobel location to the pattern. The location in which this sum is the 
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smallest is used to determine the indicator point which can represented by the frame. At 220 (FIG. 2), the distance of 

be any consistently selected point within the pattern, e.g., its each point of the identified line from the camera (i.e., 

center or one of the corners. dimension Z) is computed. The computer has stored a group 

It should be noted that if a color or a pattern is used as an 0 f points (VerticalPosiuonxHorizontalPosition) which arc 

indicator, scanning cannot take place in total darkness. The 5 the points of the line that have been identified on the (frame, 

object should be illuminated such that the color or pattern Als0j ±c coordinates of the point which represents the 

are distinguishable on the frames, but at the same time the indicator point (IndicatorHorizontalxIndicatorVertical) has 

bright illuminated line is also identifiable. been storcd [n addition> thc va]ucs 6kajsscd above havc 

In order for the software to be able to interpret the video bgen stored 

supplied by the camera as 3D geometry several measure- d * ^ mformati ^ tcr dctcrmines thc 

ments must be supplied by the user to calibrate the system. ... , 4 , I f , " 

The input and storage of this data is identified as 200 in FIG. J? m the C ^J 0T . the Stored P 01DtS on the 

2 and illustrated in further detail on FIG. 3. identified line using the following steps: 

The first entered measurement is denoted as Maximum- aipha-PixdAnglc-CVcrticalPosition-Verticaip^itionon^ximum- 

Distance. This is the most distant pomt of the object that is Distance)) 
being scanned. (See block 300, FIG. 3). The user has to 15 

measure this distance and input it into the computer. A wall .beta-atan(CamcraToUghtDtBtance/MaximumDi6tance) 

behind the object is usually the best point of reference. delta- 1 so -0.01745- (bcta+abha) 

Another entered measurement is denoted as VerticalPo- 

sitionOfMaximumDistance. See block 310. The user must depth-(sin(beta)/8in(delia))*MaximumDisUince. 
move the camera to a position where the line of light is 20 

hitting the point of MaximumDistance and measure the At the end of this computation, the distance of each point 

vertical position of this point within the video image. This ° n tne identified line from the camera has been computed as 

can be done by letting the camera point at the background. depth . 

FIG. 4 illustrates the bright line as 410 and 420 and the Next, as illustrated in block 225, a vertical position (Y) of 

indicator as 430. The portion of the bright line indicated as 25 each P° iDt 00 the identified fine is computed using the 

410 illuminates the object and another portion 420, shows following computational steps: 

the line pointing at the background wall which is at the . . B . , A , mn , ^ in ... .„ . t . ^ A . 

r , . , - *■ * ■ alpha=Pixel Angle •(VcrUcalPosiUon-VerticalPositionOfMaxunum- 

maximum, which indicates the distance of the maximum Distance)) 

depth. The vertical location of 420 with respect to the 

coordinate system of the frame is measured and stored 30 Point VcrtiralAngie=aipha-(indicatorVerticaUFixelAngle) 

indicating the vertical position of this distance of maximum Height^CPointVerticaiAngiej^epth 
depth. 

Next, the parameter denoted as Camera VerticalField- For each point, the vertical position of the point is the value 

Angle is determined and entered. See block 320. FIG. 3. of Height. 

This parameter defines the vertical field in angles of the 35 Next, the horizontal position (X) is computed for all the 

camera, in the specific magnification. See 180, FIG. 1. In points identified on the line using the following steps: 
other words, it identifies the degree of zoom that the camera 

is using in the vertical direction. This value can be deter- PointHorizontaiAngie=(HorizontaiPosition- 

j . • * . . . - , . IndicatorHorizontan'PixelAngle 

mined as a ratio between a vertical view of the camera on the ' & 

background wall and the distance from the camera to the 40 width=depth •sin(PointHorizonialAngie) 

background wall. 

Next, the CameraHorizontalFieldAngle is determined and For each P oint > the horizontal position of the point is Width, 

stored. This parameter specifies the horizontal field in angles ^ee block 230. 

of the camera, in the specific magnification. See block 330, 111 ^ree dimensions of each point have been com- 

FIG. 3. That is, this parameter determines the degree of 45 P^ted for all the points identified for the bright line in a given 

zoom in the horizontal direction. (It should be noted that in &ame > ^ nese 30 locations of the points are stored and a new 

typical commercially available cameras this value is V* of &ame is processed as discussed above. This process is 

the Camera VerticalFieldAngle). repeated while the user is moving the camera across the 

Also, the parameter CameraToLightDistance, which ob J cct until tbc ^ decides that enough information has 

denotes the vertical distance between the camera and the 50 been gathered. The same processing is performed if the 

light source when the camera is leveled, is entered and scanned images had been stored and then transferred to a 

stored. See block 340. computer at a later time. 

Finally, two parameters FrameWidth and FrameHeight M apparent to a person skilled in the art, it is possible to 

are entered and stored. See block 350. These numbers define determine 3D coordinates of the points because the station- 

the size of the frame produced by the camera in pixels. A 55 ary indicator provides sufficient information to ascertain the 

typical frame is 640x480 pixels, but other dimensions (or location of the camera. It should be noted, however, that in 

resolutions) can also be used. tne aoove computations, the camera orientation is not com- 

From this information a value denoted as PixelAngle, P utcd explicitly. Instead, the computations take into account 

which is the angle of view that the pixels in the image the . location of the indicator (IndicatorVertical, 

represent, is computed. See block 360, FIG. 3. This value 60 IndicatorHorizontal) and therefore compensate for any 

indicates the angle of the camera represented by the pixels chan 8 e in ^ camera orientation. Thus, the 3D coordinates 

of a frame. It can be computed as follows assuming that the are determined based on the camera orientation, which in 

pixels are square: torn is determined by the location of the indicator, even 

though the camera orientation is not computed as a separate 

pixelangle-CameraVertfcalFicldAagle/FrameHeigbt. ^ variable 

After the bright line and the indicator have been identified At the end of the process, 3D points collected from the 

and stored, this data is processed to determine 3D geometry frames have been stored on the computer. These points are 
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then combined into an object by connecting, every three 
points, which are the closest to each other, by a face, and 
creating a mesh representing the scanned object. See block 
235, FIG. 2. The resultant geometry is saved using an 
appropriate file format. Such file formats may include DXF, s 
VRML, 3DMF, and DepthMap as known in the art. 

Finally, color information is added to the 3D mesh. For 
this purpose, the user generates a frame for use as a color 
map. For best results the scanner light source should be 
turned off and the entire object should be illuminated. Then, 10 
the user can point the camera at the object and obtain a frame 
of the video and store it digitally as an image. Many file 
formats can be employed for this purpose, some of which are 
GIF, JPEG, BMP, PICT or any other image formats known 
in the art. The image can then be attached to the geometry, 15 
generated as discussed above, and be displayed as an inte- 
gral part of it adding a realistic look to the model. A large 
number of software packages exist that accept the geometry 
and image, and then combine and display them. These 
programs include Softimage, InfiniD, 3D Studio Max, 20 
StrataStudio and a large collection of VRML viewers. 

In the process discussed above, the resolution of the 3D 
representation is increased when the camera is moving 
slowly, thereby generating more frames with lines of light 
more closely spaced. Consequently, more points that are 25 
used for building a 3D shape are generated. On the other 
hand, if the camera is moved faster, the lines on the frames 
are further apart so that fewer points are generated. 
Accordingly, when the camera is moving faster, the resolu- 
tion decreases.., _ 30 

The present invention is not to be limited in scope by the 
specific embodiments described herein. Indeed, modifica- 
tions of the invention in addition to those described herein 
will become apparent to those skilled in the art from the 
foregoing description and accompanying figures. Doubtless, 35 
numerous other embodiments can be conceived that would 
not depart from the teaching of the present invention, which 
scope is defined by the following claims. 

What is claimed is: 

1. An apparatus for generating a 3D computer represen- 40 
tation of an object comprising: 

(a) a camera; 

(b) a light source for illuminating at least a portion of the 
object; ^ 

(c) a support for the video camera and the light source, 
wherein the support permits moving the camera and the 
light source so as to scan the object; 

(d) a stationary position indicator within a field of view of 
the camera; and 50 

(e) a computer with video capture capability for receiving 
video information captured by the camera, including 
images each of which comprising pixels representing 
an illuminated portion of the object and the position 
indicator, 55 
wherein the computer obtains calibration parameters 

during a calibration procedure, without regard to the 
indicator, based on a special relationship between the 
camera, the light source and the object, and 
wherein, after a completion of the calibration 60 
procedure, the computer receives and evaluates the 
video information associated with the object in real 
time so as to generate the 3D representation of the 
object based on a position of the indicator, the 
images and the calibration parameters. 65 

2. The apparatus of claim 1 wherein the light source 
provides a crisp line illuminating the object 
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3. The apparatus of claim 1 wherein the light source 
illuminates the object at a substantially small angle with 
respect to the direction of the camera. 

4. The apparatus of claim 1 wherein the support is such 
that a user can move the camera and the source and wherein 
when a user moves the camera and the source more slowly, 
the 3D representation is more detailed and when the user 
moves the camera and the source faster, the 3D representa- 
tion is less detailed. 

5. The apparatus of claim 1 wherein the computer pro- 
cesses video information provided by the camera in real time 
as a user scans the object using the camera. 

6. The apparatus of claim 1 wherein the video information 
is recorded on a storage medium during scanning and then 
provided to the computer at a later time for generating the 
3D representation. 

7. The apparatus of claim 1 wherein the indicator is 
positioned in the background of the object. 

8. The apparatus of claim 1 wherein the indicator is a 
bright light. 

9. The apparatus of claim 1 wherein the indicator is a 
visual two-dimensional pattern. 

10. The apparatus of claim 1 wherein the indicator is a 
color which is used to provide at least one of the orientation 
and the position. 

11. The apparatus of claim 1 wherein the support is a 
tripod. 

12. The apparatus of claim 1 wherein the light employed 
by the light source is a halogen light. 

13. The apparatus of claim 1 wherein the light source 
generates a vertical line of light and the object is scanned by 
the camera in a horizontal direction. 

14. The apparatus of claim 1 wherein the light source 
generates a horizontal line of light and the object is scanned 
in the vertical direction. 

15. The apparatus of claim 1 wherein the support is 
configured to enable a user to move the camera and the light 
source by hand. 

16. A method of obtaining a 3D computer representation 
of an object, comprising: 

a. storing, in a computer memory, images of a sequence 
of video frames obtained by scanning, each of which 
includes a depiction of a portion of the object illumi- 
nated by a line of light and a depiction of a statically- 
mounted orientation indicator; 

b. determining locations of the orientation indicator 
within the frames; 

c. performing a calibration procedure, without regard to 
the indicator, to obtain calibration parameters based on 
a spacial relationship between the camera, the light 
source and the object; 

d. after a completion of step c, determining 3D locations 
of at least some points on the portion of the object in 
real time based on pixels representing the individual 
lines of light in the sequence of frames obtained by 
scanning; and 

e. after step c and during step d, generating the 3D 
computer representation of the object using a position 
of the indicator, the calibration parameters and the 3D 
locations. 

17. The method of claim 16 wherein the step of 
determining 3D locations of the points comprise deter- 
mining a distance of a point, represented by a pixel on 
the image from a camera; determining a horizontal 
position of the point represented by the pixel; deter- 
mining a vertical position of the point represented by 
the pixel. 
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18. The method of claim 16 further comprises locating 
pixels depicting the illuminated portion of the object by 
identifying the brightest pixel among the pixels of at least a 
portion of the image. 

19. The method of claim 16 further comprising locating 
pixels depicting the illuminated portion of the object by 
identifying the first bright pixel among the pixels of at least 
a portion of the image. 

20. The method of claim 16 further comprises locating 
pixels depicted on the illuminated portion of the object by 
determining the greatest change in brightness between the 
pixels within at least a portion of the image. 

21. The method of claim 16 wherein the step of deter- 
mining the location of the orientation indicator comprises 
identifying the indicator by pixel brightness. 

22. The method of claim 16 wherein the step of deter- 
mining the location of the orientation indicator comprises 
identifying the indicator by pixel color. 

23. The method of claim 16 wherein the step of deter- 
mining the location of the orientation indicator comprises 
identifying the indicator by a pattern of pixels. 

24. The method of claim 16 further includes the step of 
creating a color map. 

25. An apparatus for scanning an object and generating a 
three-dimensional representation of at least a portion of the 
object, comprising: 

(a) a camera adapted to receive video information, and 
generate images of at least a portion of the object 
associated with the video information when the portion 
of the object is in a field of view of the camera; 
_ (b) a light source adapted to illuminate at least a portion 
of the object within the field of view of the camera 
within a line of light; 

(c) a stationary indicator positioned within the field of 
view of the camera, and 

(d) a processing arrangement adapted to obtain calibration 
parameters during a calibration procedure, the process- 
ing arrangement generating the three-dimensional rep- 
resentation using the calibration parameters, 
wherein each of the images comprises a depiction of 

the stationary indicator and a depiction of particular 
points of a portion of the object illuminated by the 
line of light, 

wherein the calibration parameters are obtained based 
on a spacial relationship between the camera, the 
light source and the object and without regard to the 
indicator, and 

wherein, after a completion of the calibration 
procedure, the processing arrangement is adapted 
receive data associated with the object in real time so 
as to construct the three-dimensional representation 
of at least a portion of the object using a position of 
the indicator, the calibration parameters and a 
sequence of such images with the particular points of 
different portions of the object illuminated by the 
line of light. 

26. The apparatus of claim 25 wherein the stationary 
indicator is a bright source of light. 

27. The apparatus of claim 25 wherein the stationary 
indicator is a distinctive color which is used to provide at 
least one of the orientation and the position. 

28. The apparatus of claim 25 wherein the stationary 
indicator is a predetermined two-dimensional pattern. 

29. The apparatus of claim 25 wherein the camera is a 
conventional video camera that can be purchased by an 
ordinary consumer. 

30. The apparatus of claim 25 wherein the camera is a 
camcorder. 
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31. The apparatus of claim 25 wherein the camera is a Hi 
8 camera. 

32. The apparatus of claim 25 wherein the camera is a 
digital camera. 

33. The apparatus of claim 25 wherein the line of light is 
vertical. 

34. The apparatus of claim 25 wherein the line of light is 
horizontal. 

35. The apparatus of claim 25 wherein the light source 
emits halogen light. 

36. The apparatus of claim 25 wherein the light source 
emits incandescent light. 

37. The apparatus of claim 25 wherein the illumination 
provided by the light source is in a direction which is at an 
angle with respect to a direction of the camera. 

38. The apparatus of claim 37 wherein the angle is 
substantially small. 

39. The apparatus of claim 25 further comprising a 
support for supporting both the camera and the fight source. 

40. The apparatus of claim 25 wherein the scanning 
includes moving the camera and the light source in a vertical 
direction while the light source illuminates the object with a 
line of light oriented in a horizontal direction. 

41. The apparatus of claim 25 wherein the scanning 
includes moving the camera and the light source in a 

1 horizontal direction while the light source illuminates the 
object with a line of light in a vertical direction. 

42. A computer method for processing a sequence of 
images, the images including a depiction of a stationary 
indicator and a depiction of a portion of an object illumi- 
nated by a line of light, the computer method comprising^ 

receiving video information associated with at least one 
portion of the object; 

identifying a location of the stationary indicator in each of 
; the images in the sequence, wherein the images corre- 
sponds to the received video information; 

performing a calibration procedure to obtain calibration 
parameters based on a spacial relationship between the 
camera, the light source and the object and without 
j regard to the indicator; 

in real time, identifying a portion of the object illuminated 
by the line of light in each of the images in the 
sequence; and 

after a completion of the calibration procedure, determin- 
45 ing 3D coordinates of at least some points located on 
the object so as to generate a 3D representation of the 
at least one portion of the object using a position of the 
indicator, the calibration parameters, and the identified 
locations of a portion of the line of light in the images. 
50 43. The method of claim 42 wherein the step of identi- 
fying the location of the indicator includes searching the 
image for one or more pixels of high brightness. 

44. The method of claim 42 wherein the step of identi- 
fying the location of the indicator includes searching the 

55 image for one or more pixels having substantially a prede- 
termined color. 

45. The method of claim 42 wherein the step of identi- 
fying the location of the indicator includes searching the 
image for a group of pixels substantially corresponding to a 

60 pattern. 

46. The method of claim 42 wherein the illuminated 
portion of the object depicted on the image comprises an 
illuminated line on a substantially dark background. 

47. The method of claim 46 further comprising identify- 
65 ing pixels located on the line. 

48. The method of claim 47 wherein the step of identi- 
fying the pixels on the line comprises locating in a plurality 
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of pixels the brightest pixel, which is not one of the pixels 
representing the indicator. 

49. The method of claim 47 wherein the step of identi- 
fying the pixels on the line comprises locating in a plurality 
of pixels a first bright pixel, which is not a pixel representing s 
the indicator. 

50. The method of claim 47 wherein the step of identi- 
fying the pixels comprises locating in a plurality of pixels a 
pixel, not representing the indicator and having the greatest 
change in brightness with respect to other pixels of the 10 
plurality of pixels. 

51. The method of claim 46 wherein the step of deter- 
mining 3D coordinates comprises determining the distance 
from the camera of the points on the object corresponding to 
the pixels of the illuminated line depicted on the image. 15 

52. An article of manufacture for processing a sequence of 
images, the images including a depiction of at least one 
portion of an object illuminate by a line of light and a 
depiction of a stationary indicator, the article of manufacture 
comprising: 20 

software for identifying locations of such stationary indi- 
cator in the images of the sequence, wherein the images 
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are associated with video information received for the 
at least one portion of the object; 

software for identifying, in real time, illuminated portions 
of the object in the images of the sequence; 

software for performing a calibration procedure to obtain 
calibration parameters based on a spacial relationship 
between the camera, the light source and the object and 
without regard to the indicator; and 

software for determining 3D coordinates of at least some 
points located on the object using a position of the 
indicator, the calibration parameters and the illumi- 
nated portion of the object so as to generate a 3D 
representation of the at least one portion of the object, 
wherein the 3D coordinates are determined after a 
completion of the calibration procedure. 

53. The article of claim 52 wherein the illuminated 
portion of the object depicted on the image comprises an 
illuminated line on a substantially dark background. 

54. The article of claim 53 further comprising software for 
identifying pixels located on the line. 

* * * * * 
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Item [57], ABSTRACT, 

Line 4, "three dimensional" should read - three-dimensional - 
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Figure 1, "orientation camera" should read - orientation of camera --; "coloravisual" 
should read -- color and visual and "pattert" should read - pattern -- 

Column 1, 

Line 8, "three dimensional" should read -- three-dimensional - 

Column 2, _ _ — _ _ 
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Line 44, "lightsource" should read - light source ~ 
Column 6, 

Line 16, "MHZ" should read - MHz - 
Column 7, 

Line 36, "HThe" should read ~ The - (append to previous line) 
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Line 42, "Delta_Color" should read DeltaColor ~ 
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